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ABSTRACT 

Hotelling's  T2  procedure  for  testing  the  significance  of  a 
mean  vector  treats  all  variables  symmetrically  and  may  not  be 
appropriate  if  the  variables  carry  unequal  importance.  The  step- 
down  procedure  due  to  J.  Roy  (1958),  a possibly  appropriate 
alternative,  is  studied  in  this  paper.  An  underlying  invariance 
structure  is  established  and  then  used  to  develop  a canonical  form 
for  studying  the  power  functions  of  the  two  methods.  A Monte  Carlo 
experiment  is  conducted  in  this  framework  and  conclusions  are 
reported. 
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The  problem  of  testing  the  significance  of  the  mean  of  a random  vector 

or  the  equivalent  problem  of  comparing  the  means  of  two  random  vectors  arises 

in  various  statistical  contexts.  The  best  known  solution  to  the  problem  is 

2 

based  upon  Hotelling's  (1931)  T test  and  has  been  extensively  studied  for 

its  optimality  properties  (Anderson  1958)  and  used  in  diverse  applications 

(Kshirsagar  1972;  Morrison  1967;  Rao  1973).  However,  some  of  the  properties 

2 

which  make  Hotelling's  T elegant  and  simple  may  render  it  inappropriate  m 

2 

some  applications.  For  example,  the  "invariant"  T -test  treats  the  variables 

symmetrically  and  consequently  may  be  unsuitable  if  these  variables  have  unequal 

2 

importance  in  the  investigation.  Yet  the  alternatives  to  the  T -test  are  very 

few.  The  purpose  of  this  article  is  to  study  one  such  alternative,  namely  the 

2 

step-down  procedure,  and  compare  it  with  Hotelling's  T solution. 

The  step-down  reasoning  for  solving  multivariate  hypothesis  testing  problems 
was  formally  initiated  by  Roy  and  Bargmann  (1958)  in  the  context  of  testing 
multiple  independence.  J.  Roy  (1958)  extended  it  to  the  problem  of  testing  a 
multivariate  general  linear  hypothesis,  which  includes  Hotelling's  problem  as  a. 
particular  case.  The  step-down  solutions  assume  an  a priori  ordering  of  the 
variables  and  involve  a sequence  of  tests  of  significance.  The  practical 
importance  of  the  step-down  procedure  also  lies  in  the  fact  that  it  permits 
recognition  of  the  unequal  relevance  of  the  variables  in  that  they  can  be  ordered 
according  to  their  importance  and  the  overall  type  I error  probability  can  be  > 

distributed  suitably  between  the  component  tests.  From  the  theoretical  standpoint 
however  very  little  is  known  about  the  step-down  tests. 


2 


In  Section  2,  we  outline  the  step-down  procedure  for  Hotelling's  problem 
and  describe  an  invariance  structure  in  which  this  procedure  as  well  as  the  T2- 
test  are  invariant.  In  Section  3,  some  properties  of  step-down  procedure  for 
Hotelling's  problem  are  discussed.  Some  estimates  of  the  power  function  of  the 
step-down  procedure  based  on  a Monte  Carlo  experiment  and  conclusions  are 
presented  in  the  final  section. 

2.  Invariance  of  the  step-down  procedure 
for  Hotelling's  T2  problem 

In  canonical  form  Hotelling's  problem  is  that  of  testing  a null  hypothesis 

Hq:  p = 0 for  a p-variate  normal  population  with  mean  vector  y * (y^y^  • • • »yp) ' 

and  positive  definite  covariance  matrix  £,  on  the  basis  of  a random  sample 

* _ n 

X.  * (x  ,...,x  )',  i = 1,  2,  ...,  n,  n > p . If  X = l X./n  and 

-1  11  1P  - i-I-1 

n _ _ 

S = I (X.-X) (X.-X) ' , then  Hotelling's  test  rejects  H for  large  values  of 

i=l  - - - 0 

2 — -1— 

T = n(n-l)X'  S X , where  the  critical  constant  for  the  test  is  determined  by  the 

2 

fact  that  under  HQ,  (n-p)T  /[p(n-l)]  has  an  F-distribution  with  p and  (n-p) 
degrees  of  freedom. 

The  step-down  procedure  proposed  by  J.  Roy  (1958)  for  the  MANOVA  problem,  when 
particularized  for  testing  HQ:  y = 0,  consists  of  a sequence  of  tests  based  upon 


statistics 


F. 

l 


(n-i)  (T^-T2^) 
[ (n-l)+T2_1l 


1, 


» P, 


(2.1)  . 


2 2 2 

where  T^  = 0,  and  T^  denotes  Hotelling's  T statistic  for  testing  (y^,...,y^)  = 

based  upon  the  first  i variates,  i = 1,2, — p.  The  null  hypothesis  Hq  is 

rejected  as  soon  as  a component  test  in  the  sequence  shows  significance.  It  is  well 

known  (J.  Roy  1958;  Roy,  Gnanadesikan  and  Srivastava  1971  [p.  473))  that  under  Hq, 

the  F^s  are  independently  distributed  according  to  F distributions  with  degrees  of 

freedom  1 and  (n-i) . Consequently  the  size  a of  the  overall  procedure  is 

P 

related  to  the  levels  a.  of  the  component  tests  by  (1-a)  = ir  (1-a.). 

i-1  1 


3 


The  well  known  invariance  structure  underlying  the  MAN OVA  problem  (e.g., 


Lehmann  1959;  Ferguson  1967)  involves  the  following  three  groups  of  transformations: 

(i)  the  translation  group  which  removes  the  irrelevant  observations  from  consideration. 


(ii)  the  orthogonal  groups  which  reduce  the  data  to  the  sum  of  squares  and  product 
matrices  H and  E due  to  hypothesis  and  due  to  error  respectively,  and  (iii)  the 


t I 

A 


group  of  premultiplication  by  nonsingular  matrices,  which  finally  yields  the 

eigenvalues  of  HE  as  a set  of  maximal  invariants.  In  this  invariance  fromework 

2 2 
the  T statistic  is  maximal  invariant  for  Hotelling's  problem  and  the  T -test  is 

best  invariant  procedure  (lehmann  1959,  [p.  299]).  Alternatively,  sufficiency 

2 

considerations,  instead  of  the  group  in  (ii) , also  lead  to  H and  E.  In  the  T - 

case  one  could  dispense  with  the  groups  at  both  the  first  and  the  second  stages. 

Thus  among  all  procedures  for  HQ  based  upon  the  sufficient  statistics  x and  S 

which  are  invariant  under  transformations  x*  = Cx  and  S*  = CSC' , where  C is  a 

2 

non-singular  matrix,  the  T test  is  known  to  be  UMP  (Anderson  1958,  [Thoerem  5.5.1, 
p.  115]).  Now  we  show  that  the  step-down  statistics  are  maximal  invariants  when 
the  transformation  matrices  C are  restricted  to  be  lower  triangular  (Theorem  2.1), 
and  later  discuss  the  nature  of  the  nonnull  joint-distribution  of  these  statistics 
(Thoerem  2.2). 

2 2 

Theorem  2.1.  If  T^  denotes  Hotelling's  T statistic  for  testing 

• • «,U^) ' " 0 based  on  the  first  i variates,  i = 1,2, ...p,  where 
y1#...,Up  are  the  means  of  the  p-variables,  then  the  step-down  statistics  in  (5.1) 
are  maximal  invariants  of  sufficient  statistic  (x,  S)  under  the  group  of 
transformations  x*  - Lx,  S*  = LSL' , where  L is  a nonsingular  lower  triangular 
matrix. 

2 2 2 

Proof.  The  statistics  F. ,F_,...,F  are  invariant,  since  T, ,T„,...,T 
1 2 p 1 2 p 

remain  invariant  under  nonsingular  lower  triangular  transformations.  We  now  show 
that  they  are  maximal  invariants.  Suppose  that  two  sets  of  data  x,S  and  y»S 

*■  .*  . -y 


4 


give  rise  to  the  same  step-down  statistics.  Let  L and  L denote  lower 

■.x  *y 

• i -i— 

triangular  matirices  such  that  Sv  = and  = L^L^  , and  U = L^  x = 


-X  _x_x 


-y  -y-y 


-1- 


(u  ,u  )',  v - L y = (v  , ...,v  )'.  Since  both  sets  of  data  yield  the  same 

1 p -y  - 1<pi 

1 2 2 

step-down  statistics,  we  have  =jl^vj  * i = l,-.-,P*  or  equivalently 

2 2 -1—  -1— 

* v^,  i.e.,  u^  *»  £ v^,  i = l,...p.  Hence  v = L^  y = Mu  = ML^  x,  where  M 

is  a diagonal  matrix  with  either  +1  or  -1  as  the  diagonal  elements.  By  taking 

L = L ML_1  , we  find  that  y = Lx  and  S = LS  L' , thus  completing  the  proof  of 

the  theorem* 

Theorem  2.2.  Maximal  invariants  in  the  parameter  space,  under  the  induced 

group  of  transf ormations , are  i = l,...p.  Equivalently,  if  B is  the 

lower  triangular  matrix  such  that  Z = BB',  and  n = B ^ p = ’ * * ,r,p^ ' ' 

2 2 2 

then  maximal  invariants  are  n, ,n_»...,n 

12  p 

Proof.  The  Theorem  follows  from  the  above  Theorem  2.1,  by  replacing  x by 
U,  and  S by  Z. 

Theorem  2.2  implies  that  the  joint  distribution  of  the  step-down  statistics 
2 

involves  only  tk,  i = l,...,p,  as  the  non-centrality  parameters,  and  that  the 

power  function  of  the  step-down  procedure  for  Hotelling’s  problem  depends  on  these 

non-centrality  parameters  only  (Lehmann  1959,  [p.  220,  Theorem  3]).  Clearly,  the 
2 

T test  is  also  invariant  under  the  transformations  considered  in  Theorem  2.1.  Its 

2 2 P 2 

power  depends  on  n. , • • . , n only  through  Z n.  - 
1 P i=l  1 

Remark  2.1.  In  the  invariance  framework,  described  above,  for  the  MANOVA 
problem  if  the  group  in  (iii)  is  replaced  by  the  group  of  nonsingular  lower 
triangular  matrices,  then  it  can  be  shown  that  the  step-down  statistics  are 
invariant.  However,  they  do  not  appear  to  be  maximal. 

3.  Some  properties  of  the  step-down  procedure 
In  this  section  we  study  the  unbiasedness  and  monotonicity  of  the  power 


function  of  the  step-down  procedure. 
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If  F , ...,F  are  the  step-down  statistics  and  a,,...»a  are  the  levels 
i P 1 p 

of  significance  with  corresponding  critical  constants  c^,...,c^,  then  the  power 

function  is  given  by 

c,  c 
1 P 

. - -/•••/  gi (Fi> g2 (F2 1 Fi)  •••  gp(FjJ  Fi'-'*'Fp-i)dFi***dFp  (3*1) 

where  g^ (F^|  F^f . . . denotes  the  conditional  distribution  of  F^  given 
F^,...,F^_^  under  the  alternative  hypothesis  at  which  g is  calculated.  Then, 
we  have  the  following  theorem. 

Theorem  3.1.  The  step-down  procedure  is  unbiased,  if  the  component  tests  are 
unbiased. 

Proof.  Given  that  the  component  tests  are  unbiased,  we  have 


f 


J £ (1-ou)  for  i = and  consequently 

” 00 

. > 

(l~Qt)  - n (l-o.)  >..ir.  J g.  (F.  If  , ...» F.  _)dF.  = 1 - & . □ 

11  1=1  1 1 * 1 l— i.  1 

" oa 

Remark  3.1.  Theorem  3.1  holds  for  the  step-down  procedure  associated  with 
MANOVA  also,  where  the  step-down  statistics  are  independently  distributed  under 
the  null  hypothesis. 

Theorem  3.2.  If  the  component  tests  are  consistent  (i.e.,  the  power  increases 
to  one  as  n ®) , then  the  step-down  procedure  is  consistent  for  any  fixed 
alternative  hypothesis. 

P 

Proof.  From  (3.1)  we  have  1 - $ * ^I1Y^(n),  where  y^n)  is  the  probability 

, th 


y^  (n)  ■*  0 as  n and  consequently  g -►  1 . 


of  type  II  error  of  i component  test.  Since  the  component  tests  are  consistent, 

□ 

We  now  consider  the  case  p * 2 for  simplicity  and  discuss  some  results 

related  to  the  power  of  the  step-down  procedure. 

Theorem  3.3.  The  power  function  of  the  step-down  procedure  for  testing 

2 2 

H0:  (u^»m2)  * (0,0)  is  an  increasing  function  of  if  n2  * 0,  and  an  increasing 

2 2 

function  of  n2  when  is  fixed. 


W 


Proof.  By  (2.1),  F 2 has  conditionally  a non-central  F distribution  with  d.f. 

2 

(l,n-2)  and  the  non-centrality  parameter  n^/Kn-l)  + F^] , it  follows  that 


i(c2,n2/[(n-i)  + fxj j = y g2(F2|F1)dF. 


is  a decreasing  function  of  n2,  and  increasing  function  of  F^.  Similarly, 
c. 


2 

j g^lF^ldF^  is  a decreasing  function  of  n^. 


It  follows  easily  that  if  n2  » 0,  I (c2»n2/ [ (n-1)  + F^] ) is  independent  of 

2 2 

and  consequently  (3.1)  is  an  increasing  function  of  . For  a fixed  value 

2 2 
of  I (c2,n2/ [ (n-l)  + F^] ) is  a decreasing  function  of  n2  implying  that 

2 

(3.1)  also  is  an  increasing  function  of  n2  • □ 

For  general  p , the  above  theorem  may  be  extended  as  follows: 


Theorem  3.4.  The  power  function  of  the  step-down  procedure  for  testing  the 

2 2 2 

hypothesis  y = 0,  is  an  increasing  function  of  when  are  f^xed 


and  n . 


0 , x 3 l,...,p. 


The  proof  is  similar  to  that  of  Theorem  3.3. 


In  order  to  see  whether  the  power  function  of  the  step-down  procedure  is  an 

2 2 

increasing  function  of  when  n2  is  fixed,  we  may  proceed  as  follows:  If  we 


denote , 


if  x <_  c1 


(2 


0 , otherwise 


then  E 2(I(x))  * l-Btn^)  as  given  in  (3.1).  Let  and  be  two  values  of 

"l  i » i •* 

0^  such  that  | I < |n^|»  and  ^ (F^*  ,g^ (F^j n^)  denote  the  p.d.  f.  of  F ^ 

« n 

when  = n^r  and  respectively.  Since  the  distribution  of  F^  belongs 

to  montone  likelihood  ratio  family  (Lehmann  [5],  p.  68),  there  exists  a point  d 


such  that 


gjtxjr^)  > g^x;^)  if  x <_  d,  and  g^xjr^)  < g^ (x» n^)  if  x > d.  But, 
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I 


E „(I(x))  - E ,(I(x))  = j I (x) [g  (x; n )-g. (x;n  ) ]dx 

nl  ni  0 


00 

" 1 

= J I(x) [gi(x;ni)-g1(x;ni)]dx 
d 

^ l n 

- J I(x) [g1(x;ni)-g1(x;ni) ]dx 


If  < d,  then  the  first  term  in  the  R.H.S.  of  (3.3)  is  zero,  for  which 

n 

reason  E „ (I(x))  < E t(I(x))  and  the  power  at  n will  be  larger  than  that  at 
ni  ni  1 

It 

For  > d,  (3-3)  could  be  positive,  in  which  case  the  power  at  will  be 

I 

smaller  than  the  power  at  n^. 

4.  A study  of  the  power  function  by  simulation 

In  this  section  we  describe  a sampling  experiment  which  provides  an  estimate 

of  the  power  function  of  the  step-down  procedure  (of  Section  2)  for  p = 2. 

Without  any  loss  of  generality  we  take  L = I^  * the  identity  matrix  of  order  2, 

2 2 

in  which  case  the  power  of  the  invariant  procedures  depends  upon  = and 

2 2 

n2  = Uj • Consequently  we  can  restrict  our  attention  to  non-negative  values  of  p^,p2 

and  observe  the  behavior  of  the  power  as  p^  and  p2  change. 

The  Monte  Carlo  experiment:  The  objective  of  the  experiment  is  to  investigate 

the  power  function  of  the  step-down  procedure  and  compare  it  with  the  power  function 
2 

of  Hotelling’s  T procedure.  The  power  of  these  procedures  has  been  computed  for 

several  values  of  p^,  p2»  namely  p^  = 0.0  (0.1)  1.6,  and  p2  = 0.0  (0.1)  1.9. 

The  standard  normal  deviates  are  generated  on  the  IBM  360/365  computer  at  the 
University  of  Rochester  using  "McGill  University  random  number  package"  based  upon 
the  technique  of  Marsaglia  [6]  for  generating  standard  normal  deviates.  A random 
observation  from  the  bivariate  normal  population  N2(y,I2)  is  obtained  by  drawing 
two  random  observations  from  a standard  univariate  normal  population  and  adding 
p^  and  p2  to  them  respectively. 

Test  procedures  considered  in  the  simulation  experiment:  For  a fixed  value  of 

fche  power  is  estimated  on  the  basis  of  3000  samples  of  size  20,  corresponding 
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i 


to  two  values  of  the  level  of  significance  a,  namely  .01  and  .05  . After 

each  sample  of  size  20  is  drawn,  the  data  are  subjected  to  the  following  tests  of 

significance,  each  of  the  tests  being  at  the  two  values  of  a. 

The  step-down  procedure  is  applied  by  setting  different  values  for  the  levels 

of  significance  a^'a2  corresponding  to  the  two  component  tests,  such  that 

r.+r  r. 

(1-ct)  = (1-e)  2 , (1-cO  = (1-e)  1 , i = 1,2.  (4.1) 

The  correspondence  between  a^’s  and  r\  1 s is  presented  in  Table  1,  with 
(r1,r2)  taking  values  (10,1) , (4,1) , (2,1) , (1,1) , (1,2) , (1,4) , (1,10)  and  ct  = .01 
and  .05  • The  power  of  a particular  procedure  at  a given  value  of  y is  estimated 

(TABLE  1 TO  GO  HERE) 

by  the  proportion  of  times  the  test  rejects  HQ  in  the  3000  trials. 

2 2 

The  power  of  Hotelling's  procedure  depends  upon  ^ + y2»  which  is 
symmetric  in  y^  and  Hence  the  power  is  obtained  for  y^  _>  y2  using  the 

routine  by  Bargmann  and  Ghosh  (1964)  for  calculating  the  cdf  of  a noncentral 
F-distribution  with  (2,  18)  d.f.  and  is  presented  in  Table  2 corresponding  to 
a = .01,  and  .05 

(TABLE  2 TO  GO  HERE) 

Results:  Several  conclusions  may  be  drawn  from  Table  2 which  presents  the 

2 

exact  power  function  of  Hotelling's  T based  on  nancentral  F distribution  and’ 
Tables  3-8  which  present  some  of  the  estimates  of  power  function  of  the  step-down 
procedure  based  on  simulation  study. 

(1)  When  r^  = r2>  i.e.,  = «2  the  simulation  indicates  a slight 

2 

superiority  of  the  step-down  procedure  over  the  T -test  along  the  corrdinate  axes 

2 

i.e.,  “ 0 or  y2  ■ 0.  On  the  other  hand  T -test  dominates  the  step-down 

procedure  along  the  equiangular  line  = y2- 

(2)  As  observed  in  Thoerem  3.3,  the  power  of  the  step-down  procedure 


insignificant  exceptions. 


(3)  The  power  of  the  step-down  procedure  at  ( ) appears  to  be  an 

increasing  function  of  if  ^ > V , and  a decreasing  function  of  if 

< V^.  Note  ^hat  for  a fixed  a,  may  be  increased  either  by  increasing  r^ 

for  a fixed  value  of  r^,  or  by  decreasing  r2  for  a fixed  value  of  r^.  (See  Table  1) . 

(4)  When  ji  V , a selection  of  (r^,  r^)  seems  possible  such  that  the  power 

2 

of  the  step-down  procedure  at  (P^,  M ) is  larger  than  that  of  Hotelling's  T 
procedure.  But  when  = P2»  such  a selection  of  (r^,  r2>  is  not  possible. 

(5)  The  power  of  the  step-down  procedure  does  not  seem  to  be  an  increasing 
function  of  P^  in  the  range  0.0  to  1.6,  for  every  fixed  value  of  l*2  y 0. 

frjnol us i on ; From  the  results  of  the  simulation  study  it  may  be  concluded  that 

if  there  is  an  a priori  ordering  among  the  response  variables  t'.ien  the  step-down 

2 

procedure  may  be  used  in  place  of  Hotelling's  T -test.  If  the  levels  of  the 

component  tests  are  equal  then  the  power  function  of  the  step-down  procedure  is 

2 

not  very  different  from  that  of  T -test.  But  by  taking  the  level  of  the  first 

component  test  ot^  large,  i.e.,  r^  large,  the  power  of  the  step-down  method  in 

detecting  the  significance  of  can  be  substantially  increased  over  the 

2 

corresponding  power  of  the  T -test. 

This  conclusion  is  supported  by  our  earlier  work  on  the  multiple  comparisons 

associated  with  the  step-down  procedure  (Mudholkar  and  Subbaiah  1975,  1976).  There 

we  observed  that  the  confidence  intervals  for  the  means  of  the  variables  appearing 

earlier  in  the  step-down  sequence  are  shorter  than  the  corresponding  widths 

2 

associated  with  the  T -test,  or  the  largest  root  test  in  case  of  MANOVA. 


In  summary,  when  the  variables  in  a multiresponse  experiment  are  of  unequal 
practical  significance,  and  are  ordered  accordingly,  a step-down  analysis  seems  to 
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yield  superior  inferences  on  the  earlier  variables  at  the  expense  of  the  quality 


of  the  inferences  on  the  later  variables,  as  compared  with  the  corresponding 


inferences  obtained  using  conventional  methods  such  as  Hotelling's  T 
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7.  THE  POWER  FUNCTION  OF  THE  STEP-DOWN  PROCEDURE  EXTIMATED  FROM 
THE  MONTE  CARLO  EXPERIMENT  OF  SECTION  4 
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8.  THE  POWER  FUNCTION  OF  THE  STEP-DOWN  PROCEDURE  ESTIMATED  FROM 
THE  MONTE  CARLO  EXPERIMENT  OF  SECTION  4 
O * .05,  r = (1,10) 
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